Snippet augmentation for videos

ABSTRACT

A video augmenting computer augments a video with snippet information. The video augmenting computer transmits requests to multiple remote video reviewing computers for a video and a snippet to augment the video. The snippet provides additional information about a particular passage from the video, and each of the requests includes a request for a profile of a reviewer of the video who created the snippet. The video augmenting computer receives the video and multiple versions of the snippet that were created by different reviewers of the video, and then compares profiles of the different reviewers to a profile of a new viewer of the video. In response to the profile of the new viewer matching a profile of a particular reviewer from the different reviewers of the video, the video augmenting computer augments the video with the snippet that was created by the particular reviewer to create an augmented video.

BACKGROUND

The present invention relates to the field of computers that are capableof displaying videos. More particularly, the present invention relatesto augmenting computer videos with information obtained from distributedsources.

SUMMARY

In a computer-implemented method embodiment of the present invention, avideo augmenting computer transmits a video to multiple reviewingcomputers along with a request for one or more snippets created by videoreviewers who are using the multiple reviewing computers, which provideadditional information about one or more video passages. The requestalso requests a video reviewer to provide a profile when returning theone or more snippets. The video augmenting computer receives one or moreresponses to the request that include the profile of the video reviewerof the video and the one or more snippets. The video augmenting computerreceives, from a new viewer, a new request to view the video along witha new viewer profile and compares profiles associated with the one ormore snippets to the new viewer profile. In response to the new viewerprofile matching a profile associated with the one or more snippets, thevideo augmenting computer augments the video with the one or moresnippets and transmits an augmented video to a client computerassociated with the new request.

Other embodiments of the present invention include a computer system anda computer program product.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts an exemplary system and network in accordance with one ormore embodiments of the present invention;

FIG. 2 illustrates an exemplary view of a system in accordance with oneor more embodiments the present invention;

FIG. 3 depicts an exemplary video that has been augmented in accordancewith one or more embodiments of the present invention;

FIG. 4 illustrates an exemplary relationship between a video augmentingcomputer and multiple remote video reviewing computers, in accordancewith one or more embodiments of the present invention;

FIG. 5 depicts an exemplary method in accordance with one or moreembodiments of the present invention;

FIG. 6 depicts a cloud computing environment according to an embodimentof the present invention; and

FIG. 7 depicts abstraction model layers of a cloud computing environmentaccording to an embodiment of the present invention.

DETAILED DESCRIPTION

With reference now to the figures, and in particular to FIG. 1, a blockdiagram of an exemplary system and network in accordance with one ormore embodiments of the present invention is depicted. Some or all ofthe exemplary architecture, including both depicted hardware andsoftware, shown for and within computer 101 can be utilized by: softwaredeploying server 149 and/or remote video reviewing computers 151 and/orclient computer 153 shown in FIG. 1; and/or video augmenting computer401 and/or remote video reviewing computers 451 a-451 b and/or clientcomputer 453 shown in FIG. 4.

With further reference to FIG. 1, exemplary computer 101 includesprocessor(s) 103, operably coupled to a system bus 105. Processor(s) 103may embody or use one or more processor core(s) 123. A video adapter107, which drives/supports a display 109, is also coupled to system bus105. In one or more embodiments of the present invention, video adapter107 detects (e.g., using inputs from keyboard 117 and/or mouse 119) thata user has paused, stopped, rewound, or otherwise interrupted the playof a video being shown on display 109.

System bus 105 is coupled via a bus bridge 111 to an input/output (I/O)bus 113. An I/O interface 115 is coupled to I/O bus 113. I/O interface115 affords communication with various I/O devices, including a keyboard117, a mouse 119, a media tray 121 (which may include storage devicessuch as CD-ROM drives, multi-media interfaces, etc.), and external USBport(s) 125. While the format of the ports connected to I/O interface115 may be any known to those skilled in the art of computerarchitecture, in one or more embodiments, some or all of these ports areuniversal serial bus (USB) ports.

As depicted, network interface 129 is also coupled to system bus 105.Network interface 129 can be a hardware network interface, such as anetwork interface card (NIC), etc. Computer 101 is able to communicatewith a software deploying server 149 and/or remote video reviewingcomputers 151 via network interface 129 and network 127. Network 127 mayinclude (without limitation) one or more external networks—such as awide area network (WAN), and/or a network of networks such as theInternet—and/or one or more internal networks such as an Ethernet or avirtual private network (VPN). In one or more embodiments, network 127includes a wireless network, such as a Wi-Fi network, and a cellularnetwork. An example embodiment of the present invention utilizing anetwork “cloud” environment will be discussed with reference to FIGS. 6and 7.

Referring again to FIG. 1, a hard drive interface 131 is also coupled tosystem bus 105. Hard drive interface 131 interfaces with a hard drive133. In one embodiment, hard drive 133 is a non-volatile memory storageand populates a system memory 135 (e.g., random access memory (RAM)),which is also coupled to system bus 105. System memory may be considereda lowest level of volatile memory in computer 101. System memory 135 mayinclude additional, higher levels of volatile memory (not shown),including, but not limited to, cache memory, registers and buffers. Datathat populates system memory 135 includes computer 101's operatingsystem (OS) 137 and application programs 143.

Operating system (OS) 137 includes a shell 139, for providingtransparent user access to resources such as application programs 143.Generally, shell 139 is a program that provides an interpreter and aninterface between the user and the OS. More specifically, shell 139(sometimes referred to as a command processor) can execute commandsentered into a command-line user interface or from a file. In otherwords, shell 139 can serve as a command interpreter. While shell 139 isa text-based, line-oriented user interface, the present invention willequally well support other user interface modes, such as graphical,voice, gestural, etc. As depicted, shell 139 can be considered thehighest level of an OS software hierarchy. The shell can also provide asystem prompt, interpret commands entered by keyboard, mouse, or otheruser input media, and send the interpreted command(s) to the appropriate(e.g., lower) levels of the operating system (e.g., a kernel 141) forprocessing.

As depicted, OS 137 also includes kernel 141, which includes(hierarchically) lower levels of functionality for OS 137. A few(non-limiting) examples of kernel functions include: providing essentialservices required by other parts of OS 137 and application programs 143,including memory management, process and task management, diskmanagement, and mouse and keyboard management.

Application programs 143 include a renderer, shown in exemplary manneras a browser 145. Browser 145 includes program modules and instructions(not depicted) enabling a World Wide Web (WWW) client (i.e., computer101) to send and receive network messages from network 127 (e.g., theInternet using hypertext transfer protocol (HTTP) messaging), thusenabling communication with software deploying server 149 and othersystems.

In some embodiments, application programs 143 in computer 101's systemmemory include Program for Augmenting Videos with Snippets (PAVS) 147.In some embodiments, system memory 135 can be shared and/or applicationprograms 143 distributed across one or more software deploying servers149 or other systems (not depicted). In the example depicted, PAVS 147includes program instructions (software) adapted for implementingprocesses and/or functions in accordance with the present invention,such as (without limitation) those described with reference to FIGS.2-5. In some embodiments, PAVS 147 is downloaded from software deployingserver 149, (on-demand or “just-in-time”) e.g., where the PAVS 147software is not downloaded until needed for execution. In someembodiments of the present invention, software deploying server 149 canperform all (or many) of the functions associated with the presentinvention (including execution of PAVS 147), thus freeing computer 101from having to use its internal computing resources.

The hardware elements depicted in computer 101 are not intended to beexhaustive, but rather are representative to highlight essentialcomponents required by the present invention. For instance, computer 101may include alternate memory storage devices such as flash memory,magnetic cassettes, digital versatile disks (DVDs), Bernoullicartridges, and the like. These and other variations are intended to bewithin the spirit and scope of the present invention.

Users often watch videos on the World Wide Web (WWW), such as on videosharing websites. Such video sharing websites allow viewers of thevideos to post opinions, questions, and other comments related to thevideos. For example, previous viewers of a video may post commentsstating that the video was unclear about a particular subject that isaddressed in the video. However, comments of one or more previousviewers may not be useful to another (i.e., current) viewer of thevideo. For example, such prior viewers' comments may be above or belowthe level of expertise of the current viewer, and thus can be considered“clutter” that simply clogs up the feed and consumes unnecessary amountsof network bandwidth.

Similarly, comments from prior viewers may be unclear as to where in thevideo their comments are directed. For example, a prior viewer commentthat “The presenter in the video is using an improper formula to explainhow to reach the answer,” can be considered unclear since it does notidentify what “formula” is thought to be improper, and is too vague withregard to the “answer.”

Thus, the current viewer may have to pause the video, use a searchengine to look up additional information about a topic in the video thatis unclear to the current viewer. Such searching can consume excessiveresources of the current viewer's computer as well as the network (e.g.,the Internet). Some embodiments of the present invention provide animprovement to the function of the current viewer's computer as well asthe network to which it is coupled. These improvements to thefunctionality of the current viewer's computer are the result ofsupplementing the video with independently obtained explanatorysnippets, based on a match to the current viewer's profile. Furthermore,network bandwidth is reduced by 1) transmitting to the current viewer'scomputer only explanatory snippets that are appropriate for the currentviewer; and 2) reducing, if not eliminating, network bandwidthconsumption otherwise caused by the current viewer searching theInternet for clarifying information. Furthermore, the efficiency of thecurrent viewer's computer can be improved by being able to efficientlydisplay the video without interruption (e.g., to search for informationon the Internet), since the explanatory snippets have pro-activelyprovided the information otherwise needed by the current viewer.

FIG. 2, depicts an exemplary view of a system in accordance with thepresent invention. As shown, in block 201, a set ofcomments/questions/feedback/etc. (e.g., comment 305 shown in FIG. 3)regarding a particular video (e.g., video 301 a shown in FIG. 3) arecreated by multiple viewers (USER 1 . . . USER N) of that particularvideo. In some embodiments, the question and answer (Q&A) “inference” inblock 201 establishes 1) which prior viewer posted the comment; 2) aprofile of the prior viewer who posted the comment; and 3) the point inthe video to which each comment is directed (i.e., time t1 in video 301a shown in FIG. 3).

Establishing 1) which prior viewer posted the comment can be ascertainedby the name/identity of the viewer (e.g., “VIEWER X” in comment 305) whoposted the comment. This information can be obtained by the postingviewer providing his/her name/pseudonym along with his/her posting.

Establishing 2) the profile of each of the prior viewers can beascertained by matching the name/pseudonym of the posting viewer with aprofile stored in a database. By way of example only, this database maybe: co-resident with the video server that serves the video; reside in a“cloud” environment, such as the example discussed below with referenceto FIG. 6 and FIG. 7; associated with a video augmenting computer (e.g.,in the viewer profile database 403 depicted within video augmentingcomputer 401 shown in FIG. 4, etc.); or some combination of one or moreof the foregoing.

Establishing 3) the point in the video to which each comment is directedcan be ascertained either from the comment itself or from an actionassociated with the posting viewer. By way of example only, the postingviewer may provide a comment such as “At 10:25 into the video, thepresenter refers to a “Monte Carlo simulation”. A Monte Carlo simulationis a mathematical technique for predicting various outcomes according totheir likelihood. Go to www.montecarlosimulationlkjlk.com for furtherinformation about Monte Carlo simulations.” (See comment 305 in FIG. 3.)

Referring again to FIG. 2, in block 202, once the above information isestablished about prior viewers of the video, video behavioral analyticsmay be performed. Such analytics may reveal points in time in the videothat were confusing for the prior viewers. Such points in time may beidentified based on when the video is paused, rewound, repeated, etc.,or may be based on when question and answer exchanges (the “above Q&Apair”) occurred among previous viewers. The time points arematched/correspond to the set of comments/questions/feedback/etc.available for the video, as established in block 201.

However, commenters often do not specify where their comment isdirected. Thus, in an embodiment of the present invention, thecommenting reviewer's computer will detect a disruption to the video tomatch a particular place in the video to the viewer's posting. Forexample, assume that the prior viewer of the video (i.e., the commentingreviewer) paused the video at the place in the video that is tenminutes, 25 seconds (10:25) from the beginning of the video. Assumefurther that while the video is paused at the 10:25 position, the priorviewer posted a comment: “The presenter refers to a “Monte Carlosimulation.” A Monte Carlo simulation is a mathematical technique forpredicting various outcomes according to their likelihood. Go towww.montecarlosimulationlkjlk.com for further information about MonteCarlo simulations”.

Referring again to FIG. 2, User 1-User N (where “N” is an integer) mayrepresent prior viewers who have paused, rewound, etc. the video atcertain time points in the video. As depicted, User 1 has paused,rewound, repeated, etc. a passage from the video at time points 206,which are displayed on playbar 208-1. Similarly, User 2 has paused,rewound, repeated, etc. a passage from the video at two other timepoints (not labeled) shown on playbar 208-2, while User N has paused,rewound, repeated, etc. a passage from the video at two different timepoints (also not labeled) shown on playbar 208-N.

In block 203, a video augmenting computer matches the times at whichviewers have paused, rewound, repeated, etc. a passage from the video tocertain profile types. Let's assume that the presenter is a biologistand that the focus of the video is biology. Let's further assume thatthe video has been completely viewed by each of Users 1-N, and at acertain point (e.g., time t3 shown in FIG. 3) the presenter beginsspeaking about “Monte Carlo simulations.” Assume also that the presenteris not an expert in predictions based on uncertainty and/or randomness,and more specifically is not familiar with “Monte Carlo simulations.”Although User 1 is an expert in biology, the profile of User 1 is silentwith regard to any interest or experience in the field of predictionsbased on uncertainty and/or randomness.

Referring specifically now to block 203 of this example (FIG. 2), asystem (e.g., video augmenting computer 401 shown in FIG. 4)consolidates the timelines in playbars 208-1 to 208-N to create anaugmented video represented by playbar 210-1 (with time points t1, t2,t4, and t5). The playbar 210-1 may be associated with future viewers(i.e., User 1) who are: 1) biologists; and 2) not experts in Monte Carlosimulations and/or predictions based on uncertainty and/or randomness;(collectively referred to as “Profile Type 1”). In other words, aversion of the video represented by playbar 210-1 may be generated forand provided to future viewers that: have paused, rewound, repeated,etc. the video at times t1, t2, t4, and t5 of the video; and have amatching Profile Type 1.

Similarly, if one or more previous viewers of the video have a “ProfileType M”, then the places in the video where they paused, rewound,repeated, etc. a passage from the video are shown as t1, t2, t3, and t4of playbar 210-M.

It is to be understood that in this example, all of the playbars 208-1through 208-N and 210-1 through 210-M are for a same video, which hasbeen or will be viewed by different viewers.

Referring now to block 204 of this example (FIG. 2), a system (e.g.,video augmenting computer 401 shown in FIG. 4) performs semantic andcontextual correlations of the video captions at the extracted timeslots (e.g., time points t1, t2, t4, and t5 of playbar 210-1) toidentify/designate augmenting information. For example, assume thatmetadata from the video, and extracted text/speech from the video aboutbiology is analyzed to reveal that at time t4 of the video the speakeris referring to Monte Carlo simulations. Assume further that User 1paused the video at time t4, and added a comment (e.g., in the commentsection of the video provider website) providing a brief explanation ofMonte Carlo simulations discussed by the presenter at time t4 (e.g., asshown in block 305 of FIG. 3). Thus, the information in block 305 can bedesignated in block 204 as “augmenting information” for the presentationat time t4 in the video for future viewers of the video whose profilematches Profile Type 1. In other words, this augmenting information(comment 305) can be considered a snippet that is presented to futureviewers of the video in order to further explain the content beingpresented at a certain time slot in the video.

Returning now to FIG. 2, in block 205, augmenting information is alignedto specific applicable points of the video, e.g., corresponding to timepoints on a playbar. Various methods (a few examples of which will bediscussed below) can be used to identify snippets (e.g., comments,advice, links to other resources, etc.) relevant to a particular place(time slot) in the video (e.g., video 301 a shown in FIG. 3).

In some embodiments of the present invention, snippets are ranked andassigned to a particular time slot (e.g., one of times t1-t5 shown inFIG. 2), using the following five steps.

Step 1. Identify a candidate snippet, such as a particular comment, anexplanation, a question and answer pair, etc. that was generated by aprevious viewer of the video.

Step 2. Identify all previous viewers who are associated with theidentified candidate snippet. For example, if the snippet is the resultof a question and answer pair, then any and all parties to that questionand answer exchange are associated with the identified candidatesnippet. By way of another example, if the identified candidate snippetis a comment, instruction, etc., then any previous viewer who commentedon that identified candidate snippet is associated with the identifiedcandidate snippet. That is, the identified candidate snippet is for asame segment of the video that was commented upon by another viewer.

Step 3. For all identified associated parties from Step 2, conduct videobehavioral analytics that reveal the time points at which theseassociated viewers may have become confused in the video e.g., based on(at least in part) when the video is paused, rewound, repeated, etc.

Step 4. By applying pattern matching, extract the time-points (extractedfrom Step 3) that are common across users belonging to a same profile.These time slots represent possible time slots to display snippetsaccording to profile types.

Step 5. Given a new user who will be watching the video, identify thespecific profile type that this new viewer belongs to. Thereafter,extract those time points that suggest confusion for that specificprofile type and conduct a semantic and contextual comparison of thesetime points with the snippets. The snippets are then ranked according totheir relevance to particular time points in the video, resulting in aranked list of snippets and time slots for each profile type.

In some embodiments of the present invention, a profile type of a newviewer of the video may be matched with one or more priorviewers/reviewers due to similarities with previous viewers (e.g.,asking similar/same questions as previous viewers, profile containssame/similar areas of expertise, etc.) In some embodiments, a profiletype of a new viewer and a particular prior viewer/reviewer may bematched when the video augmenting computer ascertains that theparticular prior reviewer has provided/created a snippet that isrelevant to viewers with the profile type of the new viewer. That is,while the prior reviewer may share some similarities with the profile ofthe new viewer, the profile and/or analysis of the particular reviewermay additionally reveal that pausing/rewinding/repeating/etc. the videowas performed at the same time point(s). However, although the priorreviewer and new viewer may have paused the video at the same times,confusion was not necessarily the cause in both cases. The priorreviewer may instead have paused the video to prepare a helpful snippet(comment, advice, a link to resources, etc.), and the relevance of theidentified snippet resulted in this prior reviewer's profile beingmatched to the profile of the new viewer.

As mentioned above, various methods can be used to identify relevant andinsightful snippets (e.g., comments, advice, links to other resources,etc.) for a particular place (time slot) in the video (e.g., video 301 ashown in FIG. 3). For example, if the snippet is a comment on a certainpassage in the video, then that comment/snippet is compared to othercomments/snippets about that passage. All of these comments/snippets canbe input to a neural probabilistic language model, which quantifies thewords and phrases in the comments/snippets in order to establish theirproximity in a vector space found in a neural network (n-space). Anexemplary process uses a term frequency−inverse document frequency(tf−idf) algorithm that weights words in the comments/snippets accordingto how often they appear. Thus, if the passage in the video is relatedto “simulations” and the term “simulation” occurs multiple times in acomment from a previous viewer, then the tf-idf algorithm will give thatcomment an appropriately higher ranking than a comment with feweroccurrences of the term. In other words, the snippets are converted intovectors that can be plotted in an n-space, such that those vectors thatare within a certain proximity in the n-space are deemed to besufficiently closely related to be appropriate for a particular type ofviewer (based on that type of viewer's profile). That is, if twovectored passages are sufficiently close together, then they are bothgoing to be useful for a same type of future viewer.

FIG. 4 illustrates an exemplary relationship between a video augmentingcomputer and multiple remote video reviewing computers, in accordancewith one or more embodiments of the present invention. By way ofoverview to the example depicted, remote video reviewing computers 451a-451 b (where “b” is an integer and analogous to remote video reviewingcomputers 151 shown in FIG. 1) initially displayed the video (e.g.,video 301 a shown in FIG. 3) and generated (or retrieved as applicable)the augmentation comments/information. By way of further example, thevideo is augmented with snippets, such as the comment 305 of FIG. 3, byvideo augmenting computer 401. Video augmenting computer 401coordinates/aligns the snippets/comments generated by the remote videoreviewing computers 451 a-451 b by aligning these snippets with aparticular time in the video based on viewer profiles, e.g., aspreviously discussed with reference to the examples of FIG. 2 and FIG.3. The augmented video (e.g., video 301 b shown in FIG. 3) iscommunicated and displayed to a subsequent viewer via network 427 andclient computer 453. Referring now to FIG. 4, each of the remote videoreviewing computers 451 a-451 b nclude snippet retrieval devices 402a-402 b, reviewer profiles 404 a-404 b and video interruption detectors407 a-407 b.

Video interruption detector 407 a can be a component of video adapter107 (shown in FIG. 1), which is able to detect when a video is paused,replayed, or otherwise interrupted by the viewer. Snippet retrievaldevices 402 a-402 b may be hardware devices (e.g., a combination ofprocessor(s) 103, hard drive interface 131, hard drive 133, and/orsystem memory 135 shown in FIG. 1) that retrieve augmentationinformation created by prior viewers of the video. This augmentationinformation (presented as “snippets” in the auto clarification section303 in FIG. 3) may be stored in the hard drive 133, system memory 135,etc. of the remote video reviewing computers 451 a-451 b. That is,comments/links/etc. created by a user of remote video reviewing computer451 a are retrieved by snippet retrieval device 402 a from storagewithin remote video reviewing computer 451 a. Reviewer profiles 404a-404 b may be profiles of reviewers of the video (and thus users of therespective remote video reviewing computers 451 a-451 b) that created asnippet (e.g., a comment, instruction, link to a resource, etc.) about aparticular passage in the video.

In one or more embodiments of the present invention, a profileidentifier (e.g., “Profile Type 1” shown in FIG. 2) is appended to theaugmented video 301 b. Thus, when video augmenting computer 401 receivesa request from client computer 453 for the video in a version that isappropriate for a viewer matching “Profile Type 1”, then only theaugmented video 301 b for viewers having “Profile Type 1” is sent to theclient computer 453. As such, the client computer 453 (which is used bya person who later views the video that was shown previously on remotevideo reviewing computers 451 a-451 b) only receives from the videoaugmenting computer 401 the augmented video appropriate for his/herprofile (e.g., augmented video 301 b in FIG. 3). Thus, the clientcomputer 453 may display the augmented video for a user having a certainprofile without any modifications or interruptions, thereby improvingthe efficiency of client computer 453 and the smooth display of thevideo. Furthermore, client computer 453 may not be not slowed down whilethe user looks up certain concepts, to the extent that such concepts arealready displayed in the augmented video 301 b, thereby furtherimproving the operation of the client computer 453 since no additionalresources are used by the new viewer, e.g., using a search engine tolook up certain concepts, information, etc. discussed in the video.Further still, network 427 (analogous to network 127 shown in FIG. 1)bandwidth can be conserved since only the augmented video 301 b need beconveyed to the client computer 453, without one or more of theprofiles, timelines, etc. generated by the various remote videoreviewing computers 451 a-451 b, thereby improving the operation ofnetwork 427.

FIG. 5 depicts an exemplary method in accordance with one or moreembodiments of the present invention. In this example, an identifier isassociated with each video. As depicted, the method begins withinitiator (start) block 501 and proceeds to block 503. In block 503, avideo augmenting computer (e.g., video augmenting computer 401 shown inFIG. 4) transmits a video (e.g., video 301 a shown in FIG. 3) tomultiple remote video reviewing computers (e.g., remote video reviewingcomputers 451 a-451 b shown in FIG. 4) along with a request for asnippet to augment the video and a profile of the reviewer who createdthe snippet. In this example, the requested snippet is to provideadditional information about a particular passage from the video. Inother words, each request not only identifies which video is beingrequested (e.g., video 301 a), but also requests a profile (e.g.,“Profile Type 1” shown in FIG. 2) of the reviewer who created thesnippet (e.g., the previous viewer who wrote a comment about a certainpassage from the video).

In block 505, the video augmenting computer receives multiple versionsof the (augmented) video that match the identifier for the video. Themultiple versions of the received video contain different snippetscreated by different reviewers of the video and various profilescorresponding to the reviewers. As is mentioned below, one or more ofsuch profiles may (or may not) match the profile of a new viewer of thevideo.

In block 507, in response to a request for a version of the video thatis appropriate for a new viewer corresponding to a particular profile,the video augmenting computer compares profiles of the differentreviewers to the profile of the new viewer of the video. If the profileof the new viewer matches a profile of a particular reviewer from thedifferent reviewers of the video (query block 509), then the videoaugmenting computer augments the video with the first snippet that wascreated by the particular reviewer in order to create an augmentedvideo, as described in block 511. If the profile of the new viewer doesnot match a profile of a particular reviewer from the differentreviewers of the video, the method proceeds to block 515.

As depicted in block 513, the video augmenting computer then transmitsthe augmented video to a client computer for display on the clientcomputer.

The flow chart ends at terminator block 515.

By way of further example, in some embodiments of the present invention,assume that the video augmenting computer receives a second snippet thatmatches the identifier of the video and (in block 509) matches theprofile of the new viewer of the video. Assume further (for purposes ofthis example only), that a first snippet was created on a first remotevideo reviewing computer (e.g., remote video reviewing computer 451 ashown in FIG. 4), while the second snippet was created on a differentremote video reviewing computer (e.g., remote video reviewing computer451 b shown in FIG. 4). In this example, the first snippet providesinformation about a particular passage from the video and the secondsnippet provides additional information about the same particularpassage from the video. The second snippet is received by videoaugmenting computer (e.g., video augmenting computer 401 shown in FIG.4) from the second remote video reviewing computer. The video augmentingcomputer then further augments the video (already augmented with thefirst snippet) by supplementing the first snippet with the additionalinformation contained in the second snippet. The further augmented video(with the combined snippets) is then transmitted to the client computerfor display. For example, comment 305, which is displayed in the autoclarification section 303 shown in FIG. 3 when the progress button 307reaches time t3 on video 301 b, reflects a modification of the firstsnippet based on another comment (the second snippet) from anotherreviewer.

By way of an alternative to the above exemplary combination of snippets,the video augmenting computer may further augment the augmented video byreplacing the first snippet with the second snippet to create a furtheraugmented video, which is transmitted to the client computer fordisplay. In other words, rather than combine two snippets as describedabove, the first snippet is deleted and replaced with the secondsnippet, and the second snippet (but not the first snippet) is presentedin the auto clarification section 303 shown in FIG. 3 when the progressbutton 307 reaches time t3 on video 301 b.

In some embodiments of the present invention, the first snippet is textthat provides additional information about a particular passage from thevideo. In some embodiments, the first snippet is a link to another videothat provides additional information about a particular passage from thevideo. In some embodiments, the first snippet is generated in responseto the first remote video reviewing computer pausing the video at theparticular passage. That is, when a reviewer of the video pauses thevideo at a particular place on the video, he/she generates the firstsnippet (e.g., comment 305 shown in FIG. 3) for that particular place onthe video.

In some embodiments of the present invention, the first snippet isgenerated in response to the first remote video reviewing computerrewinding the video at the particular passage. That is, when a reviewerof the video rewinds the video at or to a particular spot on the video,then he/she generates the first snippet (e.g., comment 305 shown in FIG.3) for that particular spot on the video. In some embodiments, the firstsnippet is generated in response to the first remote video reviewingcomputer repeating the video at the particular passage. That is, when areviewer of the video replays a certain passage of the video, he/shegenerates the first snippet (e.g., comment 305 shown in FIG. 3) for thatcertain passage that is being replayed/repeated.

In some embodiments, generation of the first snippet in autoclarification section 303 causes the first remote video reviewingcomputer to automatically pause the video, to allow the reviewer of thevideo unlimited time in which to read/play/review the content of thefirst snippet. In some embodiments, generation of the first snippet intoauto clarification section 303 causes the first snippet to be held inview while the video continues to play, until the video is manuallypaused/stopped/rewound/repeated/etc. by the reviewer of the video andthe snippet is read/played/reviewed by the reviewer at a time point ofhis choosing.

One or more embodiments of the present invention may be implemented in acloud computing environment. Nonetheless, it is to be understood thatalthough this disclosure includes a detailed description of cloudcomputing, implementation of the teachings recited herein is not limitedto a cloud computing environment. Rather, embodiments of the presentinvention are capable of being implemented in conjunction with any othertype of computing environment now known or later developed.

Cloud computing is a model of service delivery for enabling convenient,on-demand network access to a shared pool of configurable computingresources (e.g. networks, network bandwidth, servers, processing,memory, storage, applications, virtual machines, and services) that canbe rapidly provisioned and released with minimal management effort orinteraction with a provider of the service. This cloud model may includeat least five characteristics, at least three service models, and atleast four deployment models.

Characteristics are as follows:

On-demand self-service: a cloud consumer can unilaterally provisioncomputing capabilities, such as server time and network storage, asneeded automatically without requiring human interaction with theservice's provider.

Broad network access: capabilities are available over a network andaccessed through standard mechanisms that promote use by heterogeneousthin or thick client platforms (e.g., mobile phones, laptops, and PDAs).

Resource pooling: the provider's computing resources are pooled to servemultiple consumers using a multi-tenant model, with different physicaland virtual resources dynamically assigned and reassigned according todemand. There is a sense of location independence in that the consumergenerally has no control or knowledge over the exact location of theprovided resources but may be able to specify location at a higher levelof abstraction (e.g., country, state, or datacenter).

Rapid elasticity: capabilities can be rapidly and elasticallyprovisioned, in some cases automatically, to quickly scale out andrapidly released to quickly scale in. To the consumer, the capabilitiesavailable for provisioning often appear to be unlimited and can bepurchased in any quantity at any time.

Measured service: cloud systems automatically control and optimizeresource use by leveraging a metering capability at some level ofabstraction appropriate to the type of service (e.g., storage,processing, bandwidth, and active user accounts). Resource usage can bemonitored, controlled, and reported providing transparency for both theprovider and consumer of the utilized service.

Service Models are as follows:

Software as a Service (SaaS): the capability provided to the consumer isto use the provider's applications running on a cloud infrastructure.The applications are accessible from various client devices through athin client interface such as a web browser (e.g., web-based e-mail).The consumer does not manage or control the underlying cloudinfrastructure including network, servers, operating systems, storage,or even individual application capabilities, with the possible exceptionof limited user-specific application configuration settings.

Platform as a Service (PaaS): the capability provided to the consumer isto deploy onto the cloud infrastructure consumer-created or acquiredapplications created using programming languages and tools supported bythe provider. The consumer does not manage or control the underlyingcloud infrastructure including networks, servers, operating systems, orstorage, but has control over the deployed applications and possiblyapplication hosting environment configurations.

Infrastructure as a Service (IaaS): the capability provided to theconsumer is to provision processing, storage, networks, and otherfundamental computing resources where the consumer is able to deploy andrun arbitrary software, which can include operating systems andapplications. The consumer does not manage or control the underlyingcloud infrastructure but has control over operating systems, storage,deployed applications, and possibly limited control of select networkingcomponents (e.g., host firewalls).

Deployment Models are as follows:

Private cloud: the cloud infrastructure is operated solely for anorganization. It may be managed by the organization or a third party andmay exist on-premises or off-premises.

Community cloud: the cloud infrastructure is shared by severalorganizations and supports a specific community that has shared concerns(e.g., mission, security requirements, policy, and complianceconsiderations). It may be managed by the organizations or a third partyand may exist on-premises or off-premises.

Public cloud: the cloud infrastructure is made available to the generalpublic or a large industry group and is owned by an organization sellingcloud services.

Hybrid cloud: the cloud infrastructure is a composition of two or moreclouds (private, community, or public) that remain unique entities butare bound together by standardized or proprietary technology thatenables data and application portability (e.g., cloud bursting forload-balancing between clouds).

A cloud computing environment is service oriented with a focus onstatelessness, low coupling, modularity, and semantic interoperability.At the heart of cloud computing is an infrastructure comprising anetwork of interconnected nodes.

Referring now to FIG. 6, illustrative cloud computing environment 50 isdepicted. As shown, cloud computing environment 50 comprises one or morecloud computing nodes 10 with which local computing devices used bycloud consumers, such as, for example, personal digital assistant (PDA)or cellular telephone 54A, desktop computer 54B, laptop computer 54C,and/or automobile computer system 54N may communicate. By way of exampleonly, local computing devices may include one or more features and/orfunctions of computer 101, remote video reviewing computers 151, 451 a-band/or client computer 153, 453(described with reference to FIGS. 1and/or FIG. 4). Nodes 10 may communicate with one another. By way ofexample only, one or more of nodes 10, may include one or more featuresand/or functions of computer 101, and/or video augmenting computer 401(described with reference to FIGS. 1 and/or FIG. 4). Nodes 10 may begrouped (not shown) physically or virtually, in one or more networks,such as Private, Community, Public, or Hybrid clouds as describedhereinabove, or a combination thereof. This can allow cloud computingenvironment 50 to offer infrastructure, platforms and/or software asservices for which a cloud consumer does not need to maintain resourceson a local computing device. It is understood that the types ofcomputing devices 54A-54N and nodes 10 shown in FIG. 6 are intended tobe illustrative only and further that computing nodes 10 and cloudcomputing environment 50 can communicate with any type of computerizeddevice over any type of network and/or network addressable connection(e.g., using a web browser).

Referring now to FIG. 7, an exemplary set of functional abstractionlayers provided by cloud computing environment 50 (FIG. 6) is shown. Itshould be understood in advance that the components, layers, andfunctions shown in FIG. 7 are intended to be illustrative only andembodiments of the invention are not limited thereto. As depicted, thefollowing layers and corresponding functions are provided:

Hardware and software layer 60 includes hardware and softwarecomponents. Examples of hardware components include: mainframes 61; RISC(Reduced Instruction Set Computer) architecture based servers 62;servers 63; blade servers 64; storage devices 65; and networks andnetworking components 66. In some embodiments, software componentsinclude network application server software 67 and database software 68.

Virtualization layer 70 provides an abstraction layer from which thefollowing examples of virtual entities may be provided: virtual servers71; virtual storage 72; virtual networks 73, including virtual privatenetworks; virtual applications and operating systems 74; and virtualclients 75.

In one example, management layer 80 may provide the functions describedbelow. Resource provisioning 81 provides dynamic procurement ofcomputing resources and other resources that are utilized to performtasks within the cloud computing environment. Metering and Pricing 82provide cost tracking as resources are utilized within the cloudcomputing environment, and billing or invoicing for consumption of theseresources. In one example, these resources may comprise applicationsoftware licenses. Security provides identity verification for cloudconsumers and tasks, as well as protection for data and other resources.User portal 83 provides access to the cloud computing environment forconsumers and system administrators. Service level management 84provides cloud computing resource allocation and management such thatrequired service levels are met. Service Level Agreement (SLA) planningand fulfillment 85 provide pre-arrangement for, and procurement of,cloud computing resources for which a future requirement is anticipatedin accordance with an SLA.

Workloads layer 90 provides examples of functionality for which thecloud computing environment may be utilized. Examples of workloads andfunctions which may be provided from this layer include: mapping andnavigation 91; software development and lifecycle management 92; virtualclassroom education delivery 93; data analytics processing 94;transaction processing 95; and video augmentation processing 96, whichcan perform one or more features of the present invention.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of the presentinvention. As used herein, the singular forms “a”, “an” and “the” areintended to include the plural forms as well, unless the context clearlyindicates otherwise. It will be further understood that the terms“comprises” and/or “comprising,” when used in this specification,specify the presence of stated features, integers, steps, operations,elements, and/or components, but do not preclude the presence oraddition of one or more other features, integers, steps, operations,elements, components, and/or groups thereof.

The corresponding structures, materials, acts, and equivalents of allmeans or step plus function elements in the claims below are intended toinclude any structure, material, or act for performing the function incombination with other claimed elements as specifically claimed. Thedescription of various embodiments of the present invention has beenpresented for purposes of illustration and description, but is notintended to be exhaustive or limited to the present invention in theform disclosed. Many modifications and variations will be apparent tothose of ordinary skill in the art without departing from the scope andspirit of the present invention. The embodiment was chosen and describedin order to best explain the principles of the present invention and thepractical application, and to enable others of ordinary skill in the artto understand the present invention for various embodiments with variousmodifications as are suited to the particular use contemplated.

Methods described in the present invention may be implemented throughthe use of a VHDL (VHSIC Hardware Description Language) program and aVHDL chip. VHDL is an exemplary design-entry language for FieldProgrammable Gate Arrays (FPGAs), Application Specific IntegratedCircuits (ASICs), and other similar electronic devices. By way offurther example (only), one or more computer-implemented (e.g., insoftware) methods described herein may be emulated by a hardware-basedVHDL program, which can then be applied to a VHDL chip, such as a FPGA.

The present invention may be a system, a method, and/or a computerprogram product at any possible technical detail level of integration.The computer program product may include a computer readable storagemedium (or media) having computer readable program instructions thereonfor causing a processor to carry out aspects of the present invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer readable storage medium, as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing device receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, or either source code or object code written in anycombination of one or more programming languages, including an objectoriented programming language such as Java, Smalltalk, C++ or the like,and conventional procedural programming languages, such as the “C”programming language or similar programming languages. The computerreadable program instructions may execute entirely on the user'scomputer, partly on the user's computer, as a stand-alone softwarepackage, partly on the user's computer and partly on a remote computeror entirely on the remote computer or server. In the latter scenario,the remote computer may be connected to the user's computer through anytype of network, including a local area network (LAN) or a wide areanetwork (WAN), or the connection may be made to an external computer(for example, through the Internet using an Internet Service Provider).In some embodiments, electronic circuitry including, for example,programmable logic circuitry, field-programmable gate arrays (FPGA), orprogrammable logic arrays (PLA) may execute the computer readableprogram instructions by utilizing state information of the computerreadable program instructions to personalize the electronic circuitry,in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that the computerreadable storage medium having instructions stored therein comprises anarticle of manufacture including instructions which implement aspects ofthe function/act specified in the flowchart and/or block diagram blockor blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

Having thus described embodiments of the present invention of thepresent application in detail and by reference to illustrativeembodiments thereof, it will be apparent that modifications andvariations are possible without departing from the scope of the presentinvention defined in the appended claims.

What is claimed is:
 1. A computer-implemented method comprising:transmitting, from a video augmenting computer to multiple reviewingcomputers, a video and a request for one or more snippets created byvideo reviewers who are using the multiple reviewing computers to viewthe video, wherein the one or more snippets provide additionalinformation about one or more video passages in the video, and whereinthe request also requests that each video reviewer include a videoreviewer profile when returning the one or more snippets; receiving, bythe video augmenting computer, one or more responses to the request,wherein each of the one or more responses comprise the one or moresnippets and the video reviewer profile for a video reviewer thatcreated each of the one or more snippets; receiving, by the videoaugmenting computer and from a new viewer, a new request to view thevideo along with a new viewer profile; comparing, by the videoaugmenting computer, video reviewer profiles associated with the one ormore snippets to the new viewer profile; in response to the new viewerprofile matching a video reviewer profile associated with the one ormore snippets, augmenting, by the video augmenting computer, the videowith the one or more snippets to create an augmented video; andtransmitting, from the video augmenting computer to a client computerassociated with the new request, the augmented video.
 2. Thecomputer-implemented method of claim 1, wherein the one or more snippetsis a first snippet, and wherein the computer-implemented method furthercomprises: associating, by one or more processors, an identifier withthe video; receiving, by the video augmenting computer, a second snippetthat matches the identifier of the video and the new viewer profile ofthe new viewer of the video, wherein the second snippet providesadditional information about the particular passage from the video, andwherein the second snippet is received from a second remote videoreviewing computer; further augmenting, by the video augmentingcomputer, the augmented video based on the second snippet, to create afurther augmented video; and transmitting, from the video augmentingcomputer to the client computer, the further augmented video.
 3. Thecomputer-implemented method of claim 2, wherein said further augmenting,by the video augmenting computer, the augmented video based on thesecond snippet, to create a further augmented video, further comprises:further augmenting, by the video augmenting computer, the augmentedvideo by replacing the first snippet with the second snippet to create afurther augmented video.
 4. The computer-implemented method of claim 1,wherein the one or more snippets are text that provides additionalinformation about a particular passage from the video.
 5. Thecomputer-implemented method of claim 1, wherein the one or more snippetsare links to another video that provides additional information about aparticular passage from the video.
 6. The computer-implemented method ofclaim 1, wherein the one or more snippets are generated in response tothe first remote video reviewing computer pausing the video at theparticular passage.
 7. The computer-implemented method of claim 1,wherein the one or more snippets are generated in response to one ormore of the multiple remote video reviewing computers rewinding thevideo at the particular passage.
 8. The computer-implemented method ofclaim 1, wherein the one or more snippets are generated in response toone or more of the multiple remote reviewing computers repeating thevideo at the particular passage.
 9. A computer program product,comprising a computer readable storage device having programinstructions embodied therewith, the program instructions readable andexecutable by a computer to: transmit, from a video augmenting computerto multiple reviewing computers, a video and a request for one or moresnippets created by video reviewers who are using the multiple reviewingcomputers to view the video, wherein the one or more snippets provideadditional information about one or more video passages in the video,and wherein the request also requests that each video reviewer include avideo reviewer profile when returning the one or more snippets; receive,by the video augmenting computer, one or more responses to the request,wherein each of the one or more responses comprise the one or moresnippets and the video reviewer profile for a video reviewer thatcreated each of the one or more snippets; receive, by the videoaugmenting computer and from a new viewer, a new request to view thevideo along with a new viewer profile; compare video reviewer profilesassociated with the one or more snippets to the new viewer profile; inresponse to the new viewer profile matching a video reviewer profileassociated with the one or more snippets, augment the video with the oneor more snippets to create an augmented video; and transmit, from thevideo augmenting computer to a client computer associated with the newrequest, the augmented video.
 10. The computer program product of claim9, wherein the one or more snippets is a first snippet, and wherein theprogram instructions are further readable and executable by the computerto: associate an identifier with the video; receive, by the videoaugmenting computer, a second snippet that matches the identifier of thevideo and the new viewer profile of the new viewer of the video, whereinthe second snippet provides additional information about the particularpassage from the video, and wherein the second snippet is received froma second remote video reviewing computer; 28 further augment theaugmented video based on the second snippet, to create a furtheraugmented video; and transmit, from the video augmenting computer to theclient computer, the further augmented video.
 11. The computer programproduct of claim 9, wherein the one or more snippets are text thatprovides additional information about a particular passage from thevideo.
 12. The computer program product of claim 9, wherein the one ormore snippets are links to another video that provides additionalinformation about a particular passage from the video.
 13. The computerprogram product of claim 9, wherein the one or more snippets aregenerated in response to the first remote video reviewing computerpausing the video at the particular passage.
 14. The computer programproduct of claim 9, wherein the program instructions are executed as aservice in a cloud environment.
 15. A computer system comprising: one ormore processors; one or more computer readable memories, operablycoupled to the one or more processors, wherein the one or more computerreadable memories store program instructions for execution by at leastone of the one or more processors, the stored program instructionscomprising: program instructions to transmit, from a video augmentingcomputer to multiple reviewing computers, a video and a request for oneor more snippets created by video reviewers who are using the multiplereviewing computers to view the video, wherein the one or more snippetsprovide additional information about one or more video passages in thevideo, and wherein the request also requests that each video reviewerinclude a video reviewer profile when returning the one or moresnippets; program instructions to receive one or more responses to therequest, wherein each of the one or more responses comprise the one ormore snippets and the video reviewer profile for a video reviewer thatcreated each of the one or more snippets; program instructions toreceive, from a new viewer, a new request to view the video along with anew viewer profile; program instructions to compare video reviewerprofiles associated with the one or more snippets to the new viewerprofile; program instructions to, in response to the new viewer profilematching a video reviewer profile associated with the one or moresnippets, augment the video with the one or more snippets to create anaugmented video; and program instructions to transmit, to a clientcomputer associated with the new request, the augmented video.
 16. Thecomputer system of claim 15, wherein the one or more snippets is a firstsnippet, and wherein the stored program instructions further comprise:program instructions to associate an identifier with the video; programinstructions to receive a second snippet that matches the identifier ofthe video and the new viewer profile of the new viewer of the video,wherein the second snippet provides additional information about theparticular passage from the video, and wherein the second snippet isreceived from a second remote video reviewing computer; programinstructions to further augment the augmented video based on the secondsnippet, to create a further augmented video; and program instructionsto transmit, to the client computer, the further augmented video. 17.The computer system of claim 15, wherein the one or more snippets aretext that provides additional information about a particular passagefrom the video.
 18. The computer system of claim 15, wherein the one ormore snippets are links to another video that provides additionalinformation about a particular passage from the video.
 19. The computersystem of claim 15, wherein the one or more snippets are generated inresponse to the first remote video reviewing computer pausing the videoat the particular passage.
 20. The computer system of claim 15, whereinthe program instructions are executed as a service in a cloudenvironment.